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DETAILED ACTION 



1 . This action is responsive to communications : original application filed 2/6/2002, 
drawings filed 3/25/2002. The present application is a continuation (filed under 37 CFR 1.53(b)) 
of parent case 08/900,421 (now abandoned). Said parent case filed 7/25/1997. 

2. Claims 1-20 are pending. Claims 1, 14, 16, 19, 20 are independent claims. 



Claim Rejections - 35 USC § 102 
3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in- 

(1) an apphcation for patent, pubUshed under section 122(b), by another filed in the United States 
before the invention by the apphcant for patent, except that an international application filed under the 
treaty defined in section 35 1(a) shall have the effect under this subsection of a national application 
published under section 122(b) only if the international application designating the United States was 
published under Article 21(2)(a) of such treaty in the English language; or 

(2) a patent granted on an application for patent by another filed in the United States before the 
invention by the applicant for patent, except that a patent shall not be deemed filed in the United States 
for the purposes of this subsection based on the filing of an international application filed under the 
treaty defined in section 35 1(a). 



4. Claims 1, 9, 16 are rejected under 35 U.S*C. 102(e) as being anticipated by Katseff et 
al. (hereinafter Katseff), U.S. Patent No. 5,822,537 issued October 1998. 



In regard to independent claim 1, Katseff discloses: 

- an audio and a video stream stored in a file, server, said streams are a preferred file 
format for access by a user (Katseff column 5 lines 18-24, column 6 lines 60-67, colxmin 7 lines 
1-7, column 8 lines 18-22; conpare with claim 1 retrieving a time-based stream and a motion 
data stream at the server, each stream comprising frames of data 
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- synchronizing audio and video portions of a recorded presentation by placing the frames 
into an audio buffer, and a video buffer (Katseflf column 8 lines 60-65, column 9 lines 1-5; 
conpare with claim 1 "variably buffering one of the time-based data stream and the motion 
stream to produce two streams having synchronized frames 

- a multimedia object at a workstation synchronizes the presentation of audio and visual 
mediums (Katseff coliunn 9 lines 1-5; con:5)are with claim 1 ''using the synchronized frames at 
the client for playback of synchronized motion and time-based data to a user. 

In regard to dependent claim 9, Katseff discloses a method whereby an information 
retrieval system sends a retrieval message over a network to a storage and retrieval system, said 
storage and retrieval system accesses a file server for fQe retrieval (preferably JPEG Movie 
Format), and sends the file to the user (Katseff column 6 lines 60-67, column 7 lines 1-7, colimm 
8 lines 40-50; conpare with claim 9), 

In regard to independent claim 16, claim 16 reflects the apparatus used to perform the 
methods conprising con^uter readable instructions as claimed in claim 1, and is rejected along 
the same rationale. 

Claim Rejections - 35 USC§103 
5. The following is a quotation of 35 U.S.C 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 
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6. Claims 2, 4, 12, 14, 18 are rejected under 35 U.S.C 103(a) as being unpatentable 
over Katseff as applied to claim 1 above, and further in view of Shibata, Y., Media 
synchronization protocols for packet audio-video system on multimedia information 
networks (hereinafter Shibata), IEEE; January 3-6, 1995 pp.594.601. 

In regard to dependent claim 2, with reference to paragraph 2 of the rejection of claim 
I, Katseff does not specifically teach a method whereby the variably buffering occurs at server. 
However, Shibata teaches a method whereby a rate control message is sent to a server, said server 
dynamically updating the current frame rate, including its parameters (Shibata p. 596, Frame rate 
control; con5)are with claim 2, '\.Mt the server. It would have been obvious to one of ordinary 
skill in the art at the time of the invention to apply the server participation method of Shibata to 
the buffer method of Katseff, because of Shibata's taught advantage of server interaction, 
providing increased equitable workload to the buffer method as disclosed by Katseff. 

In regard to dependent claim 4, Katseff teaches a method whereby an audio and a video 
stream is stored in a file server, said streams are a preferred file format for access by a user, and 
said files transferred from server to a workstation client (Katseff column 5 lines 18-24, column 6 
lines 60-67, column 7 lines 1-7, column 8 lines 18-22, Figure 1). 

Katseff does not specifically teach a method where transfer of data values for a frame 
occurs only for a frame that has changed since a last frame was transmitted However, Shibata 
discloses a method whereby audio data is sent from the video server to the client station only 
during a ''talk spurt '\ with constant frame rates occurring during periods of audio silence 
(Shibata p.597, 4.3 Silence detected synchronization; conpare with claim 4). It would have been 
obvious to one of ordinary skill in the art at the time of the invention to apply the method of 
Shibata to the method of Katseff, because of Shibata's taught advantage of selected data 
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transmission, providing increased file size and transmission reduction of the audio and video 
buffering method as disclosed by Katseff 

In regard to dependent claim 12, claim 12 incorporates substantially similar subject 
matter as claimed in claim 1, and in further view of the following, is rejected along the same 
rationale. 

Claim 12 "wherein the time-based data is a pre-recorded audio track.., is rejected using 
the same arguments presented in the rejection of claim 1. 

Claim 12 "...and the method further includes synchronizing playback of the pre-recorded 
audio track'' and "buffering of the pre-recorded audio track... " is rejected using the same 
arguments presented in the rejection of claim 1. 

Claim 12 "...to allow for coupling with motion data generated in time with the playback 
of the pre-recorded audio track'' is rejected using the same arguments presented in the rejection 
of claim 1. 

Katseff does not specifically teach a method of irrplementing the subject matter 
mentioned in the above three paragraphs at a server. However, Shibata teaches a frame rate 
control method inplemented on both the client and server-side of a network, whereby a cHent rate 
control message is sent to the server, at which time the server adjusts its own frame rate (Shibata, 
pp. 595-596 System Architecture, paragraph 5, and p. 596 Frame rate control; compare with 
claim 12 "...at the server... It would have been obvious to one of ordinary skill in the art at the 
time of the invention to apply the server method of Shibata to the methods of Katseff, because of 
Shibata' s taught advantage of server control, providing increased equitable workload to the video 
method as disclosed by Katseff 
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In regard to independent claim 14, Katseff teaches: 

- an audio and a video stream is stored in a file server, said streams are a preferred file 
format for access by a user, and said files transferred fi-om server to a workstation client (Katseff 
column 5 lines 18-24, column 6 lines 60-67, column 7 lines 1-7, column 8 lines 18-22, Figure 1). 

- Katseff does not specifically teach a method whereby a last data value for each channel 
in each fi-ame transmitted over the network is stored. However, Shibata teaches a method 
whereby a rate controller periodically monitors and stores in RAM a current fi-ame rate, a 
number con5)uted by fi-ames/seconds (Shibata p.596 Frame rate control, column 1; compare with 
claim 14 "storing a last data value for each channel in each frame transmitted over the 

c 

network''). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to apply the fi^ame rate monitoring method of Shibata to the method of Katseff, because 
of Shibata's taught advantage of periodic monitoring, providing increased continuous monitoring 
of the audio and video buffering method as disclosed by Katseff. 

- an audio and a video stream is stored in a file server, said streams are stored as 
synchronized JPEG Movie Files for access by a user, and said files transferred fi'om server to a 
workstation client (Katseff column 5 lines 18-24, colimin 6 lines 60-67, column 7 lines 1-7, 
column 8 lines 18-22, Figure 1; compare with claim 14 ''retrieving new synchronized frames for 
transmission over the network"). 

Claim 14 ''packaging and transmitting over the network only data for channels having 
changed data values'', is rejected using the same argument and rationale presented for the current 
rejection of claim 4. 

In regard to dependent claim 18, claim 18 reflects the apparatus used to perform the 
methods comprising computer readable instructions as claimed in claim 14, and in fiarther view of 
the following, is rejected along the same rationale. 
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With reference to paragraph 1 of the rejection of claim 14, Katseff does not teach an 
apparatus to hold data values last transmitted over a network. However, it would have been 
obvious to one of ordinary skill in the art at the time of the invention to modify Katseff to 
incorporate a storage device to hold data values, because secondary storage devices (ie. disk 
arrays) are disclosed as exan5)les of suggested storage devices that can be used to hold data 
(Katseff, column 4 lines 61-64; conpare with claim 18 "..m storage device., for storing data 
values... Applying a storage device provides increased data persistence to the audio/video 
streaming method as disclosed by Katseff. 

7. Claim 3 is rejected under 35 U.S.C. 103(a) as being unpatentable over Katseff as 
applied to claim 1 above, and further in view of Baumgartner et al. (liereinafter 
Baumgartner), U.S. Patent No. 5,642,171 issued June 1997. . 

In regard to dependent claim 3, with reference to paragraph of the rejection of claim 1, 
Katseff does not teach a method whereby a difference between the delay for the audio and motion 
data stream to determine which stream is faster is calculated. However, Baxmigartner teaches a 
method whereby a current video frame number is subtracted from a current audio frame number 
to determine if the audio is too far ahead of the video (Baumgartner column 13 lines 60-67, 
column 14 lines 1-2; conpare with claimS). It would have been obvious to one of ordinary skill in 
the art at the time of the invention to apply the difference calculation method of Baimigartner to 
Katseff, because of Baumgartner' s taught advantage of audio/video comparison, providing 
increased time synchronization to the server buffer method disclosed by Katseff. 
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8. Claims 5, 13 are rejected under 35 U.S.C. 103(a) as being unpatentable over Katseff, 
as applied in claim 1 above. 

In regard to dependent claim 5, Katseff teaches a method of storing and distributing 
multimedia objects over a network (Katseff, column 2 lines 8-12). Katseff does not specifically 
teach a method of using the Intemet for object distribution. However, it would have been obvious 
to one of ordinary skill in the art at the time of the invention to modify Katseff to incorporate the 
Intemet for object transmission, because an intemet is disclosed as an example of suggested types 
of networks that can be used (Katseff, column 3 lines 58-63; coii5)are with claim 5). Applying 
this form of network provides increased communication range to the distribution method 
disclosed by Katseff.. 

In regard to dependent claim 13, claim 13 incorporates substantially similar subject 
matter as claimed in claim 1, and in further view of the following, is rejected along the same 
rationale. 

With reference to paragraph 3 of the rejection of claim 1, Katseff does not teach a method 
of sequencing output for ordered playback of the synchronized frames. However, it would have 
been obvious to one of ordinary skill in the art at the .time of the invention to modify Katseff to 
incorporate the method of sequenced output for ordered playback, because forward and reverse 
playback of videos is disclosed as examples of videos resulting from the iir5)lementation of the 
invention disclosed by Katseff (Katseff, column 14 lines 13-19; conpare with claim 13 
''...sequencing... '\ and "...to provide for ordered playback of the synchronized frames to a user at 
the client. "). Applying the method of an ordered sequence to the playback of a video file provides 
increased organization to the method disclosed by Katseff. 
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9. Claims 6, 7, 10, 17, 19 are rejected under 35 U.S.C 103(a) as being unpatentable 
over Katseff as applied to claims 1 and 16 above, and further in view of Durward et al. 
(hereinafter Durward), U.S* Patent No. 9,950,202 issued September 1999. 

In regard to dependent claim 6, Katseff teaches a method whereby an audio and a video 
stream is stored in a file server, said streams are a preferred file format for access by a user 
(Katseff column 5 lines 18-24, colxuim 6 lines 60-67, column 7 Hues 1-7, column 8 lines 18-22). 
Katseff does not specifically teach a method whereby motion data is mapped to control 
movement of a virtual figure displayed in a scene at the client. However, Durward teaches a 
method whereby updated positional data from a person's head position sensor is mapped and used 
to determine the position of a virtual being defined for that user, communicating graphical data to 
the user (Durward, column 6 lines 29-32, column 7 lines 12-20; conpare with claim 6). It would 
have been obvious to one of ordinary skill in the art at the time of the invention to apply the 
virtual position data of Durward to the method of Katseff, because of Durward's taught advantage 
of three dimensional position mapping, providing increased spatial imagery to the video stream 
method as disclosed by Katseff 

In regard to dependent claim 7, with reference to the rejection of claim 6, Katseff does 
not specifically teach a method of using a body suit for generating motion data. However, 
Durward teaches a method of sensing position data with the use of a body suit (Durward, column 
3 line 25-33; confpare with claim 7). It would have been obvious to one of ordinary skill in the art 
at the time of the invention to apply the body suit method of Durward to the method of Katseff, 
because of Durward's taught advantage of three dimensional physical contour mapping, 
providing increased spatial image accuracy to the video stream method as disclosed by Katseff 



Application/Control Niimber: 10/068,829 
Art Unit: 2176 



Page 10 



In regard to dependent claim 10, with reference to the rejection of claim 6, Katseff 
does not specifically teach a method of using voice data as time-based data. However, Durward 
teaches a method of assigning soxmd data as voice data (Durward, column 7 Hne 53-57; con:5)are 
with claim 10). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to apply the voice data method of Durward to the method of Katseff, becaiise of 
Durward's taught advantage of voice mapping, providing increased aural communication to the 
audio method as disclosed by Katseff. 

In regard to dependent claim 17, with reference to paragraph 3 of the rejection of 

claim 1, Katseff does not specifically teach an apparatus whereby synchronized motion/time- 
based data is milticasted to clients in a network. However, Durward teaches an apparatus whereby 
users log on to a system via modems, said users data is shared with other users and continuoxisly 
updated so as to create a virtual reality world (Durwald, column 8 lines 22-24, 41-64, Figure 1; 
compare with claim 17). It would have been obvious to one of ordinary skill in the art at the time 
of the invention to apply the data sharing method of Durward to the method of Katseff, because 
of Durward's taught advantage of consistent data sharing, providing continuous updating and 
increased uniform user awareness in a virtual environment to the method as disclosed by Katseff. 

In regard to independent claim 19, claim 19 incorporates substantially similar subject 
matter as claimed in claim 6, and in further view of the following, is rejected along the same 
rationale. 

Katseff teaches a method whereby a multimedia object at a workstation synchronizes the 
presentation of audio and visual mediums (Katseff column 9 lines 1-5). Katseff does not 
specifically teach a method of playing back in synchronization with movement of the virtual 
figure the time-based data. However, Durwald teaches a method of assigning soiuid data to a 
corresponding virtual space, i.e. the assignment of a user's voice to the voice of the 
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corresponding virtual being (Dxuward, column 7 lines 53-60; conpare with claim 19 ''playing 
back in synchronization with movement of the virtual being the time-based data. It would have 
been obvious to one of ordinary skiU in the art at the time of the invention to apply the voice data 
method of Durward to the method of KatsefF, because of Durward's taught advantage of voice 
mapping, providing increased awal communication to the video method as disclosed by Katseff. 

10. Claims 8, 11 are rejected under 35 U.S.C 103(a) as being unpatentable over Katseff 
as applied to claim 1 above, and further in view of Wasserman et al. (hereinafter 
Wasserman), U.S. Patent No. 5,812,791 issued September 1998. 

In regard to dependent claim 8, with reference to paragraph 1 of the rejection of claim 
1, Katseff does not specifically teach a method whereby motion data includes backgroxmd data 
used for producing a scene at the server. However, Wasserman teaches a method whereby images 
are deconpressed for the use of textures, or backgroxmds with overlays of moving video on the 
still images (Wasserman, column 6 lines 8-16; compzxt with claim 8). It would have been 
obvious to one of ordinary skill in the art at the time of the invention to apply the background 
texture method of Wasserman to the method of Katseff, because of Wasserman's taught 
advantage of scenery data inclusion, providing increased visual realism to the video method as 
disclosed by Katseff.. 

In regard to dependent claim 1 1, Katseff teaches a method whereby an audio and a 
video stream is stored in a file server, said streams are a preferred synchronized file format (JPEG 
Movie File) for access by a user (Katseff column 5 lines 18-24, column 6 lines 60-67, column 7 
lines 1-7, column 8 lines 18-22; conpare with claim 1 1 "...the synchronized data frames include 
one or more data channels,.. 
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KatsefF does not specifically teach a method whereby a descriptor packet is transmitted 
between synchronized frames so that a client may join in progress a multicast of synchronized 
data frames. However, Wasserman teaches a method of inserting presentation timestanps into an 
MPEG stream every 0.7 seconds, said time stan[5)s represent times at which a video picture is to 
be displayed, or starting audio playback times (Wasserman, column 4 lines 37-44; coin)are with 
claim 1 1 "the server transmitting,.., of synchronized data frames. It would have been obvious 
to one of ordinary skill in the art at the time of the invention to apply the timestamp method of 
Wasserman to the method of Katseff, because of Wasserman's taught advantage of embedded 
synchronization, providing increased client synchronization accuracy to the video method as 
disclosed by Katseff 

11. Claim 15 is rejected under 35 U.S.C. 103(a) as being unpatentable over Katseff and 
Shibata as applied to claim 14 above, and further in view of Wasserman. 

In regard to dependent claim IS, claim 15 incorporates substantially similar subject 
matter as claimed in claim 1 1, and is rejected along the same rationale. 

12. Claim 20 is rejected under 35 U.S.C. 103(a) as being unpatentable over Katseff and 
Dunvard as applied to claims 10 and 17 above, and further in view of Baumgartner. 

In regard to independent claim 20, claim 20 incorporates substantially similar subject 
matter as claimed in claims 1, 10, 16 and 17, and in frulher view of the following, is rejected 
along the same rationale. 

Claim 20 '^''retrieving an audio stream... .including frames of data'' is rejected using the 
same arguments presented in paragraph 1 of the rejection of claims 1 and 10. 
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Katseff teaches a method whereby an audio and a video stream is stored in a file server, 
said streams are a preferred file format for access by a user (Katseff column 5 lines 18-24, 
column 6 lines 60-67, column 7 lines 1-7, column 8 lines 18-22). 

Katseff does not specifically teach a method whereby a delay is calculated through a 
server for a fi-ame of data on each of the streams. However, Baumgartner teaches a method 
whereby an audio firame number is determined fi*om a query of the corresponding audio firame 
position, said fi-ame nuinber is used in reference to a starting time index (Baumgartner column 6 
lines 45-50, column 13 lines 48-59; conpare with claim 20 ''calculating a delay,., " and yor a 
frame of data on each of the streams It would have been obvious to one of ordinary skill in the 
art at the time of the invention to apply the fi*ame number method of Baumgartner to the method 
disclosed by Katseff, because of Baumgartner's taught advantage of time/fi-ame comparison, 
providing increased time synchronization to the server buffer method disclosed by Katseff. 

Claim 20 "calculating a difference between the delay. ...of the two streams is faster'' is 
rejected using the same argument presented for the current rejection of claim 3. 

Additionally, with reference to paragraph 3 of the present rejection, Katseff does not 
specifically teach a method whereby the faster stream is buffered, resulting in synchronized 
streams. However, Baumgartner teaches a method whereby audio is adjusted if it is determined 
that the audio is too far ahead of the video, or the video is adjusted if the video is too far ahead of 
the audio (Baumgartner column 14 lines 4-7, 15-17; compare with claim 20 ''variably buffering a 
faster of the streams,,, .having synchronized data frames''). It would have been obvious to one of 
ordinary skill in the art at the time of the invention to apply the comparison/adjustment method 
of Baumgartner to the method disclosed by Katseff, because of Baumgartner's taught advantage 
of audio/video speed conparison, providing increased time synchronization to the server buffer 
method disclosed by Katseff. 

Claim 20 ''packaging the synchronized data frames" is rejected using the same argument 
presented for the rejection of claim 16. 
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Claim 20 ''multicasting the synchronized data frames to one or more clients on a 
network' is rejected using the same argument presented for the rejection of claim 17. 

Claim 20 "ar each client computer.,, .for display to a user*' is rejected using the same 
argument presented in paragraph 3 of the rejection of claim 1 . 

13. Prior art made of record and not relied upon is considered pertinent to disclosure. 



Miller U.S. Patent No. 5,974,496 issued 10/1999 

Moezzi et al. U.S. Patent No. 5,850,352 issued 12/1996 

Takeuchi U.S. Patent No. 5,986,633 issued 11/1999 

Veltman U.S. Patent No. 5,481,543 issued 1/1996 

Richter et al. U.S. Patent No. 6, 104,706 issued 8/2000 

Ara2d et al. U.S. Patent No. 5,966, 120 issued 10/1999 



Shibata, Y.; Media synchronization protocols for packet audio-video system on 
multimedia information networks, IEEE, System Sciences Vol 3, pp. 594-601. 

Shibata, Y.; A unified media presentation for multimedia information networks, IEEE 
Parallel and Distributed Systems, 1996, pp. 16-2 1. 

Conclusion 

14. This is a continuation of applicant's earlier Application No. 08/900,421. All claims are 
drawn to the same invention claimed in the earlier application and could have been finally 
rejected on the grounds and art of record in the next Office action if they had been entered in the 
earKer application. Accordingly, THIS ACTION IS MADE FINAL even though it is a first 
action in this case. See MPEP § 706.07(b). Applicantisremindcdof the extension of time policy 
as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
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will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no, however, 
event will the statutory period for reply expire later than SIX MONTHS from the maihng date of 
this final action. 

15. Any inquiry concerning this communication or earHer communications from the 
examiner should be directed to William Bashore whose telephone number is (703) 308-5807. 
The examiner can normally be reached Monday through Friday from 1 1 :30 AM to 8:00 PM EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor. Heather Hemdon, can be reached on (703) 308-5186. 

Any inquiry of a general nature or relating to the status of this application should be 
directed to the Group receptionist whose telephone number is (703) 305-3900. 

16. Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

or faxed to: 

(703) 746-7239 (for formal communications intended for entry) 

or: 

(703) 746-7240 (for informal or draft communications, please label 
"PROPOSED" or "DRAFT") 

or: 

(703) 746-7238 (for after-final communications) 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal Drive, 
Arlington, VA, Fourth Floor (Receptionist). 



William L. Bashore 
07/26/2002 




